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INTRODUCTION 


I  . 


The  linear  regulator  is  one  of  the  most  extensively 
studied  and  well  known  problems  of  optimal  control  theory. 


L 1 , 2 , 3 j 4 j 5 ? 6 , 7 j 8 J .  This  importance  stems  from  the  fact  that 


many  practical  control  problems  can  be  formulated  in  the 
linear  regulator  form.  Its  most  desirable  feature  is  that 
the  optimal  control  law  employs  linear  state- var iable  feed- 
ba  ck . 

A.  THE  GENERAL  LINEAR  REGULATOR  PROBLEM 

A  linear  regulator  problem  may  be  formulated  as  follows: 
Consider  a  completely  controllable,  completely  observable 
multivariable  time-varying  dynamic  system 


x(t)  =  A( t )x( t ) +B( t ) u( t ) 
and  the  performance  index 


(i-i) 


+uT (t)R(t)u(t))dt,  (1-2) 


where  the  real  symmetric  nxn  weighting  matrices  Q(t)  and  H 
are  non-negative  definite,  and  the  real  symmetric  mxm  weighting 
matrix  R(t)  is  positive  definite.  x(t)  is  the  nxl  state  vector, 
u(t)  is  the  mxl  vector  of  controls,  B(t)  is  an  nxm  matrix,  A(t) 


is  an  nxn  matrix  and  the  final  time,  t ^ ,  is  fixed.  The  optimal 

*  ^  t 

control  u  (t)  minimizes  J,  and  is  given  by  ll,2J 


u*(t)  =  -R_1( t)BT( t)K( t)x( t) , 


u  (t)  =  -  F  (t)x(t) . 


(1-3) 
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K(t)  is  the  nxn  positive  definite  symmetric  matrix  solution 
to  the  Riccati  equation 

K(t)  =  -AT(t)K(t)-K(t)A(t)-Q(t)+K(t)B(t)R_1(t)BT(t)K(t)  (1-4) 

with  the  boundary  condition 

K(tf)  =  H.  (1-5) 

Because  the  system  is  assumed  to  be  controllable  and 
observable,  it  is  possible  to  achieve  arbitrary  dynamics  with 
state-var iable  feedback  L y J .  The  practical  application  of 
optimal  linear  regulator  theory  to  system  design  leads  to 
the  problem  of  selecting  the  weighting  matrices.  The  state 
trajectory  of  the  optimal  system  given  by  the  solution  of 

x(t)  =  La(  t  )-B(  t  )F*(  t)  Jx(  t)  (1-6) 

is  dependent  upon  the  weighting  matrices  chosen.  It  is 
therefore  desirable  to  establish  a  relationship  between  the 
weighting  matrices  and  the  design  objectives  (such  as  percent 
overshoot,  time  to  overshoot  and  settling  time)  with  the  ob¬ 
jective  of  developing  a  design  procedure. 

B.  A  RESTRICTED  LINEAR  REGULATOR  PROBLEM 

This  thesis  considers  only  the  time- invar iant ,  single¬ 
input,  finite  final-time  (tf  <  00 )  linear  regulator  problem. 

For  this  problem  A,  R,  and  Q  are  constant  matrices  and  B  is 
the  constant  nxl  vector  b. 
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C.  LITERATURE  SURVEY 


None  of  the  literature  surveyed  proposes  a  systematic 
procedure  for  finding  a  suitable  weighting  matrix  Q  for  the 
finite  final-time  problem  (  t  <  )  The  infinite  final-time 

problem  has  been  considered  by  several  authors  [5?7j8J. 

The  most  extensively  used  method  for  selecting  a  suitable 
weighting  matrix  Q  is  to  make  an  educated  guess,  observe  the 
result,  and  update  the  guess.  The  major  fault  here  is  that 
there  is  no  guarantee  that  an  acceptable  Q  can  be  found  in  a 
feasible  number  of  trials. 

The  most  definitive  procedure  for  finding  Q  in  the  infi¬ 
nite  final-time  problem  has  been  developed  by  Chen  and  Shen  l7J- 
In  their  procedure  a  weighting  matrix  is  selected  to  yield  a 
set  of  desired  closed-loop  eigenvalues.  A  direct  relationship 
between  an  incremental  change  in  the  closed-loop  eigenvalues 
and  the  corresponding  change  in  the  weighting  matrix  Q  is 
established  using  Jacobifs  sensitivity  formula  and  perturbation 
of  the  steady-state  solution  of  the  Riccati  equations  (K  =  0). 
Two  iterative  algorithms  are  given  for  the  determination  of 
the  elements  of  the  weighting  matrix  Q 

This  procedure  would  be  difficult  to  extend  to  the  finite 
final-time  problem  because  a  desired  set  of  time-varying  eigen¬ 
values  would  have  to  be  formulated*  It  was  felt  that  this 
extension  would  not  be  beneficial* 
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A  different  approach  was  taken  by  Wakeland  in  his  doctoral 
dissertation  [8j.  He  considers  the  system  given  by 

£  =  A e  (1-7) 

where  A  is  an  nxn  matrix  in  phas e- var iable  form  H  9  J  and  e 

is  the  vector  difference  between  the  system  output  c_  and  the 

desired  system  output  r^.  The  performance  criterion  used  is 

00 

J  =}  eT  Qedt  (1-8) 

0 

where  Q  is  an  nxn  diagonal  matrix.  Wakeland Ts  empirical 
results  show  that  the  elements  of  the  weighting  matrix 

Q  =  diag  L 1 , q22 > q33 > • • • j qnn^  (1-9) 


are  directly  related  to  the  slopes  of  the  elements  of  the 
cost  functional  with  respect  to  the  parameters  of  the  system 
matrix,  where  the  cost  functional  is  expressed  as 


J 


2  3 

e2dt 


2 

e  dt . 
n 


(1-10) 


The  weighting  matrix  elements  are  defined  in  terms  of  these 
slopes  for  second- , third-and  fourth-order  systems.  Analytic 
relationships  between  weighting  matrix  elements  and  system 
parameters  are  developed,  and  graphs  and  tables  that  repre¬ 
sent  these  relationships  for  second- , thir d-and  four  th-order 
systems  are  given.  These  graphs  and  tables  present  the  re¬ 
lationships  between  weighting  matrix  elements  and  certain 
time-response  performance  characteristics  such  as  overshoot 
and  settling  time 
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Schultz  and  Melsa ,  [ 5 J ,  consider  the  inf ini te- t ime  problem 


(  =  00 )  where  the  system  is  assumed  to  be  in  phase- var  iable 

form  and  show  that  the  cost  functional  given  by 

J  (xT(  t)Qx(  t)+ru(t)")dt  (1-11) 


may  be  reduced  to 


■/’  f  <rT* 

o  L 


(t))  +ru(t)  dt+x  (<*)Sx(®)-x  (O)Sx(O)  .  (1-12) 


S  is  an  nxn  symmetric  constant  matrix  whose  n  row  and  n 

columns  are  set  to  zero,  in  order  to  make  the  reduction  in- 

T 

dependent  of  the  system  (A,b)  Since  the  term,  (0)Sx.(0), 

depends  only  on  the  initial  conditions,  x(0),  it  has  no 

.  .  .  T 

effect  in  the  minimization  of  J0  For  the  term,  x^  (<» )  Sx^00 )  , 

to  have  no  effect,  the  system  must  be  asymptotically  stable. 

The  reduced  performance  index  has  only  n  weighting  factors 

to  be  considered  which  can  be  related  to  the  concept  of 

model  ing ,  L  5J  •  The  elements  of  the  weighting  vector,  form 

the  coefficients  of  an  ( n- 1 ) s t-or der  differential  equation 


,( n  -I ) 

•  d  y 

y  v  +  v  v  +  y  V“^  . « - —  —  o 

1  y2  3y  'r\  dt(  n- 1 ) 


(1-13) 


which  must  be  satisfied  by  the  output  of  the  system  under 
consideration  to  minimize  J.  Therefore,  equation  (1-13)  is 
regarded  as  a  model  for  which  a  desired  response  is  formulated 
the  model  is  adjusted  to  satisfy  classical  response  charac¬ 
teristics,  such  as  rise-time,  overshoot,  phase  margin,  and  so 
forth.  The  adjusted  coefficient  vector,  is  the  weighting 
vector  for  the  performance  index., 
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II . 


FORMULATION  OF  THE  WEIGHTING-MATRIX  SELECTION  PROBLEM 


A.  INTRODUCTION 

The  basic  system  considered  is  a  controllable,  observable, 
multivariable,  t ime- in var iant ,  s ingle- input ,  linear  dynamic 
system  given  by 

x(t)  =  Ax(t)  +  bu(t).  (II-l) 

The  performance  index  to  be  minimized  is  given  by 

ft 

J  =  h\  (xT( t )Qx( t ) +  u2(t))dt.  (II -2) 

0 

The  optimal  control  that  minimizes  equation  (II-2)  is  given 
by 

U*(t)  =  -  bTK(t)x(t) .  (II-3) 

K(t)  is  the  solution  to  the  reduced  Riccati  equation 

K(t)  =  -  ATK(t)-K(t)A-Q+K(t)bbTK(t) ,  (II-4) 

which  has  the  boundary  condition 

K(tf )  =  0.  (II-5) . 

B.  TRANSFORMATION  TO  CANONICAL  FORMS 

It  was  decided,  from  a  computational  standpoint,  that  the 
number  of  non-zero  elements  of  the  Q  matrix  should  be  small. 
For  this  reason,  transformation  of  the  system  to  two  canonical 
forms  was  examined;  the  diagonal  state-matrix  form  and  the 
phase- var iable  form. 
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A  system  that  has  no  multiple  eigenvalues  may  be  readily 
transformed  into  one  that  has  a  diagonal  A  matrix  by  the 
following  procedure.  The  system  has  a  column-par t ioned  matrix 
of  eigenvectors  given  by 


E 


e  e 

-1-2 


e 

— n 


] 


(II -6) 


wher 


e  each  eigenvector  is  associated  with  its  eigenvalue 


X..  This  matrix  may  be  normalized  to 
1 


A 

E  = 


A  A  A 

e  e  .  .  .  e 

— 1  2  — n 


(n-7) 


by  normalizing  the  individual  eigenvectors  to  unit  magnitude. 

A 

By  letting  x( t )  =  Ez(t),  the  new  system  is  given  by 


A(t)  =  Ax£( t)+b1u( t) , 


(II“8) 


wher  e 


A,  = 


A  A 
E  AE 


(II-9) 


and 


b  = 


A-1 
E  b. 


(11-10) 


The  matrix  has  the  form 


Ax  o  o  .  . 


Ai  = 


0  a2  0 

o  o  A . 


o  X 


(ii-ii) 


13 


With  the  system  in  this  form,  a  diagonal  Q  matrix  may  be  used 
and  still  have  complete  influence  on  feedback;  but  the  elements 
of  the  matrix  A^  may  be  conjugate  complex.  This  requires  that 
all  computation  be  done  using  complex  arithmetic. 

Since  the  system  under  consideration  is  completely  con¬ 
trollable,  it  can  be  transformed  into  the  phase- var iable  form 
with  a  linear  non-singular  transformation  matrix  T,  by  letting 
x  =  Tz  as  in  Rane  C 9 J .  This  leads  to  the  phase- var iable  system 


i  -  Ao£  ♦  bou 


(11-12) 


where  the  system  matrix  has  the  form 


0 


0  10  0 
0  0  10 
0  0  0  1 


o.  .  . 
0  .  .  . 


1 

o 


-a  -a 

1  2 


0 

1 

-a 


(II-13) 


and  b^  =  Lo0....0l].  The  elements  in  the  last  row  of  A^ 

(a^,  i  =  l,...,n)  are  the  coefficients  of  the  characteristic 
polynomial  for  the  original  system  matrix  A.  This  polynomial 
is  given  by 


n  n-1  n-2 

s  +a  s  +a  _  s  + , 
n  n-1 


,  +a 


r 


The  transformation  matrix  T  is  given  by 


,t  J 

— n 


(ii-i4) 


(11-15) 
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where  the  element  vectors  may  be  formed  by  the  recursive 


r  elat ions 


t  =  b 

— n  — 


t  =  At  +t  a 
— n  - 1  — n  — n  n 


t 

— n- 


2 


At  +t  a 

— n  - 1  — n  n  ■ 


ti 


At  +t  a 

—2  — n 


2 


C.  DIAGONAL I ZAT I ON  OF  THE  Q  MATRIX 


(11-16) 


Kriendler,  L  4J  >  states  and  proves  the  following  theorem. 
If  a  linear  time-invar iant  plant  is  in  the  phase-variable 
form,  then  for  any  positive  semidefinite  matrix  Q  in  the 
quadratic  performance  index 

J  =  hj  (xTQx+u2)dt,  (11-17) 

0 


there  exists  a  unique  diagonal  matrix 

Q*  =  diagiq11>q’2 . Ci  ,n3 

which  yields  the  same  optimal  control 


u  (t)  =  -  bT K  ( t )  x(  t ) 


(11-18) 


(II-19) 


and  is  related  to  Q  by  the  formula 
* 


wher  e 
able 


^ii  ^ii  2<^i-l ,  i*+l+2<^i-2  ,  i-t-2 
the  alternating  sum  is  continued  until  all  of 
q*s  are  exhausted.  Even  though  .  Q_xs^~r  equired 


(11-20) 

the  avail- 
to  be _ 


* 


positive  semidefinite,  Q  needed  not  be  so  restricted.  Let 
Q  be  the  positive  definite  matrix 


15 


10 


0  2 


Q  = 


0  10 
2  0  1 


(11-21) 


Then 


* 

Q 


diag  Ul0,-3,lj 


( 11-22) 


* 


where  Q  is  unique. 

* 

It  should  be  noted  from  equation  ( II -20 )  that  Q  does  not 

depend  on  the  elements  q_  of  Q  where  i  +  j  is  an  odd  number. 

Therefore  when  the  system  is  in  the  phase- var iable  form,  an 

equivalent  matrix  (simpler  than  Q)  may  be  considered, 

where  q^  .  .  =  q.  .  if  i+j  is  even  and  q^ .  .  =0  if  is  i+j  odd. 

1  ij  M  ij  J 

The  matrix  retains  the  positive  definiteness  or  semi¬ 
definiteness  of  Q. 

The  optimal  feedback  control  law,  £,  defined  by 

p  =  bXK(t),  (11-23) 


is  a  time-varying  row  vector  consisting  of  the  n  column 

of  the  Riccati  solution,  K,  for  a  plant  in  phase- var iabl e 

form.  For  the  infinite-time  problem,  the  diagonal  weighting 
* 

matrix  Q  is  unique  and  yields  the  same  feedback  £  as  that 
corresponding  to  the  original  matrix  Q,  where 

e  *  A.  *  •  (n-24) 

D.  INITIAL  CONDITION  CONSIDERATIONS 


Designing  a  system  for  a  specific  initial  condition  does 
not  necessarily  produce  the  desired  time  response  for  other 
initial  conditions.  A  conservative  design  approach  is  adopted 
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here  by  assuming  that  worst-case  initial  conditions 
Worst-case  initial  conditions  are  defined  as  those 
maximize  the  minimum  value  of  the  performance  index 
by 


J  .  =  xT(0)K(0)x(0) . 

J  .  is  maximized  when  x(0)  is  colinear  with  the  ei 
associated  with  the  largest  eigenvalue  of  K(0),[2], 


occur . 

which 
as  given 

(11-25) 

genvector 
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Ill  problem  solution 


A -  SEARCH  IN  Q  SPACE 

The  most  direct  approach  to  selecting  the  weighting 
matrix,  Q,  would  be  to  perform  an  exhaustive  search,  evalu¬ 
ating  the  state  trajectory  for  each  of  several  selections 
of  Q.  Even  for  a  low-order  system,  this  is  a  formidable 
task . 

A  more  reasonable  approach  is  to  make  an  estimate  for  Q, 
evaluate  the  state  trajectory  and  then  change  Q  based  on  the 
closeness  of  the  state  trajectory  to  the  design  objectives. 
This  procedure  is  continued  until  the  state  trajectory  is 
acceptable.  As  this  requires  a  subjective  decision,  time- 
shared  computer  operation  is  a  necessity. 


B.  STATE-TRAJECTORY  SENSITIVITY 

The  sensitivity  of  the  state  trajectory  with  respect  to 

Q,  fn  >  can  be  evaluated  by  using  the  sensitivity  function 
oU 

approach.  This  involves  solving  the  Riccati  equation 


K  =  -  ATK-KA+KbbTK-Q 


(III-l) 


with  the  boundary  condition 

K(tf)  =  0  (IH-2) 

simultaneously  with  its  associated  sensitivity  equation 


d  (  dK\_  T  oK  dK  dK  T  ,  ,  ,T  dj£ 

dt  Uq  "  ‘  A  S'  SA  *5“^  K  *  35 


dQ 

dQ 


fs  (III-3) 


with  the  boundary  condition 


dK(tf ) 

~dQ 


=  0. 


(in-4) 
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Then  the  state  equation 


x  =  Ax  +  bu 


x(0)  =  x 

—  v  /  —0 


( m-5) 


must  be  solved  simultaneously  with  its  associated  sensitivity 
function  equation 


d_  (  &x(tA 
dt  \  dQ  J 


T  dx 
(A-bbTK)  5= 


bb 


(III-6) 


with  the  boundary  condition 

a(x(0)) 


SQ 


=  0. 


( III-7) 


t  hi 

For  an  n  -order  system,  Equation  III-S  contains  n  first- 

2 

order  differential  equations ,  Equation  III-l  contains  n 

.  ,  n • ( n  +  1 ) 

first-order  differential  equations  of  which  •>»■■■  i*  ^  are 

unique  since  Q,  K,  and  K  are  symmetric  matrices.  Equations 

^  ^  .  .  /  n^n+ln^  ^  fn-(n  +  l)\ 

III-3  and  Ill-o  contain  l  — - H  and  n  ^  unique 

first-order  differential  equations,  respectively,  Table  I 
demonstrates  the  rapidity  with  which  the  computational  com¬ 
plexity  increases. 


Table  I.  The  number  of  differential  equations,  N, 
that  must  be  solved  for  a  system  of  order 
n  to  evaluate  the  state- trajectory 
sens  it  i  vi  ty  ,  dx/dg 

n  N 

1  4 

2  20 

3  63 

4  J  54 

5  }20 

10  11025 
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dx 

The  s tate- trajectory  sensitivity  matrix,  — ,  must  be 

oQ 

observed  over  the  entire  trajectory  to  obtain  a  relationship 
between  it,  the  state  trajectory  and  a  new  weighting  matrix. 

A  subjective  decision  in  the  selection  of  a  new  Q  is  required 
since  there  does  not  exist  a  direct  analytical  relationship 
between  the  design  objectives  for  a  finite  final-time  problem 
and  the  weighting  matrix  Q. 


C.  THE  DESIGN  MEASURE  m 
1 .  Def in  it  ion 

The  approach  that  seemed  most  promising  required  the 
formulation  of  a  vector  design  measure, 

m  =  f(Q;x*,t) .  ( III-8) 


Typical  examples  of  the  elements  of  m  are  listed  below 

a.  Max|u(t)|  0  ^  t  ^  t 

t 

b.  Percent  overshoot 

c.  Time  to  maximum  overshoot 

d.  Time  to  first  zero  crossing 

e.  Time  to  reach  and  remain  within  5  percent  of  the 
final  value 


9- 

h. 


dx ( t ) dt 
S  a 


where 


dx(  t ) 
d  a 


is  the  s  tate- 


trajectory  sensitivity  to  variation  in  system  parameters,  a^, 
and  s  is  a  symmetric  positive  definite  matrix. 
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The  elements  of  m  are  further  restricted  to  be  defined 
so  that  they  will  be  positive.  (It  should  be  noted  that  an 
analytical  expression  for  the  partial  differential  of  the 
elements  of  m  with  respect  to  the  elements  of  Q  does  not 
generally  exist.) 

The  desired  vector  design  measure  was  defined  to  be 

* 

m  ;  the  vector,  f ,  has  the  elements  defined  by 
A  ,  *  * 

fj  -  I  I  D  =  1,2, ...,L  ( III-9 ) 


where  L  is  a  positive  integer.  The  elements  of  f  are  to  be 
made  acceptable  by  adjusting  the  weighting  matrix  Q. 

2 ,  Difference  Approximation  to  the  Sensitivity  Matrix  dm/dQ 

dm 

The  sensitivity  matrix,  can  be  approximated  by 

oQ 

perturbing  the  weighting  matrix  elements  q__  to  form  a  finite- 

difference  approximation  to  the  partials, 
vector  differential  din  is  given  by 

dm  T 

dm  = 
dm 

where  r-—  has  the  form 


The 


dm  =  —  dQ, 


dm 

dQ 


dm^ 

Sq 


11 


din 


dm, 

dq 

dm. 


11 


dq22 


22 


d  mn 


dm. 


d  q  dq 


nn 


nn 


( III-10) 


dm^ 


dm^ 

dq 


nn 


(in-ii) 
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and  dm  and  dQ  are  both  column  vectors,  with  dimensions  (Lxl) 
and  ( mxl )  respectively.  Equation  (III-10)  is  used  to  select 
a  dQ  that  will  reduce  as  many  of  the  elements  of  the  design- 
measure  difference  vector,  ^f,  as  possible. 

3 .  Computational  Algorithm  for  Selecting  Q 

The  steps  of  the  basic  algorithm  for  finding  the  "best" 
weighting  matrix  are  outlined  in  Flow-Chart  1,  with  details 
given  by  the  following  list. 

a.  Transformation  of  the  system  into  the  phase- 
variable  form,  in  order  to  use  a  diagonal  weighting  matrix  Q. 

b.  Selection  of  an  initial  diagonal  weighting  matrix. 

c.  Formation  of  the  design  measure  m  by: 

(1)  Integrating  the  Riccati  equation 

(2)  Finding  the  worst-case  initial  conditions 
x ( 0 )  from  K ( 0 ) „ 

(3)  Integrating  the  state  equations  with  K(t) 

and  x ( 0 )  . 

(4)  Setting  m  =  f(Q;x  ,t,t  )  . 

d.  If  m  is  not  defined  or  is  unreasonable,  a  restart 
at  step  b;  m  is  not  defined  if  some  element  does  not 
For  example,  if  the  optimal  system  is  overdamped, 
overshoot  has  no  meaning. 

e.  Formation  of  the  design-measure  sensitivity  matrix 

(1)  Perturbing  the  Q  elements,  q^  ,  i=l  ,2  ,  .  .  .  ,n  . 


is  made 
exis  t . 
per  cen  t 


dm 

_=  by: 

c>Q 
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(2)  Integrating  the  n  sets  of 

J11 ,q22 


H2 


m 


R icca t i 


equations,  K.1,  with  Q1  =  diagonal  (  q,  1  ,qOQ,  •  •  •  ,qii+dqii<  .  .  .  ,qnn) 


for  i  =  1 , 2  ,  .  .  .  ,  n. 

(3)  Integrating  the  n  state  equations  using  K1(t). 

(4)  Forming  the  perturbed  vector  performance 

i  .  _  , 

measures,  m  ,  l  -  l,....,n. 

mVm. 

(  5 )  i  “  1,2,  .  .  .  .  ,  n  ;  j  -  1,2,..  .  .  ,  L  . 

4ii  Mii 

d  m 

f.  Selection  of  a  normalized  dQ,  using  a  ,  that 

—  oQ 

will  improve  as  many  of  the  elements  m^  as  possible.  This 
procedure  is  discussed  in  more  detail  in  section  III  c4. 

g.  Selection  of  the  magnitude,  Oi ,  for  dQ  and 
evaluation  of  m’  by: 

(1)  Initializing  OL 

(2)  Setting  Q  =  Q  +  QfldQ  where  I  is  the  nxn 
identity  matrix. 

(3)  Forming  the  vector  performance  measure  m 

r 

for  this  value  of  Q  by: 

(a)  Integrating  the  Riccati  equation’s 

using  Q* . 

(b)  Finding  the  worst-case  initial  con¬ 
ditions  x'(0)  for  K^O). 

(c)  Integrating  the  state  equation’s  with 

x  T  ( 0 )  and  K 1 ( t ) . 

(  d)  Setting  m*  =  f  (  Q  *  ;x  1  ,  t ,  ) 
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h.  Formulation  of  subjective  decisions  based  on 

Li  =  |  1  ( 1 11-12 ) 

and 

i  * 

li  -  i  1  =  1,2,. ..,L  (III-13) 

(1)  f 1  is  considered  to  be  an  improvement  on  f 
if  any  of  the  following  conditions  exists: 

t 

(a)  f±^fi  1  =  1»2> • • • 

(b)  The  number  of  values  of  i  for  which 
f!  £  f.  is  greater  than  L/o 

li  ^ 

(2)  if 1  is  considered  to  be  acceptable  at  this 
step  if  any  of  the  following  conditions  exist: 

(a)  f!  ^  g!  for  a  majority  of  the  elements 

v  /  i  i 

f  |  where  g!  is  a  positive  small  number ;  i  = 

(b)  a  ^  e  p;  where  Gp  is  a  small  pos it ive  number. 

i 

(3)  £  is  considered  to  be  acceptable  for  the 
design  if  any  of  the  following  conditions  exist 

(a)  f!  t’V  for  a  majority  of  the  elements 

\  /  i  i 

of  fT  where  G  V  is  a  small  positive  number  ( G  V  <  e!)  and  it  is 
—  i  v  i  i 

clear  that  no  further  significant  improvement  can  be  made  in 
the  other  elements  by  moving  locally. 

(b)  OL  t  1  where  G  f  is  a  small  positive 

P  P 

number  and  the  inequality  G*  «  G  holds. 

P  P 

(4)  (a)  If  h  (1)  is  true,  increase  OL  and  go 

to  step  g .  (2)  . 

(b)  If  h.(l)  is  not  true,  decrease  OL  and 

go  to  s  tep  g . ( 2  )  . 

(c)  If  h .  ( 2 )  is  true,  go  to  step  e,  with 


•Q  =  Q’ . 
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Flow-Chart  1. 


Basic  Steps  of  One  Iteration  of  Design  Algorithm 
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Flow  Chart  1. 


continued 
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i.  Testing  the  weighting  matrix  found  by  perturbing 

t 

Q  to  determine  if  a  significant  reduction  can  be  made  on  the 

elements  of  f 1 .  If  a  significant  improvement  can  be  made  go 

to  step  e,  with  Q  =  Q*. 

4.  Considerations  for  Selecting  dQ 

a.  Problem  Formulation 

3m  . 


The  vectors,  ’  J  =  .  .  .  ,L,  are  normalized 


3Q 


to  the  vectors  w  .  by 

-J 


d  m  . 


w  .  =  r— * 

“J  dQ 


(in-:U) 


j  =  1,2, .. .L. 


n 

L1 

i=l 


o  m  .\ 

dQ 


There  exist  L  hyperplanes  H^.  defined  by 

Hj:  =  °  j  =  (III-15) 

where  (.  ,  .  )  denotes  the  inner  product  in  n-dimens ional 

Euclidian  space,  En .  w  is  in  the  direction  of  the  largest 
rate  of  increase  of  dm_.  .  Therefore  the  best  fcQ  to  select 

for  a  particular  3m.  is  colinear  with  f w  .  The  sign 

“J  — J 

l  *  I 

selected  must  be  that  which  causes  dm.  to  minimize  f  m.-m. 

— J  J  J  J  1 

For  L  >  1,  a  systematic  procedure  must  be  established  to 


select  a  dQ  that  will  minimize  as  many  f.?s  as  possible. 

—  J 

The  unit  normals,  n  ,  j  =  1,2,...,L,  that  result 

in  a  reduction  of  f  .  are  given  by 

J 


n  .  =< 

“J 


w  . 

m  . 

< 

* 

m  . 

“J 

J 

J 

-w  . 

m  . 

* 

m  . 

J 

J 

J 

j  -  1,2, ... ,L. 


(III-16) 
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Defining  ^  =  bQ,  there  exist  L  half-spaces  S^ ,  where  S^. 
is  the  set  of  all  that  satisfy  the  relation 


2:0  j  =  1 , 2  ,  .  .  .  ,  L . 


( III-17) 


Thus  the  hyperplane  and  its  normal  define  a  half-space 

S.  which  is  the  set  of  all  points  that  reduce  f  .. 

J  J 

The  intersection  of  all  the  S.rs,  given  by 


L 


s  =  n  s., 

j=i  J 


(m-i8) 


defines  the  set  of  all  points  that  reduce  all  f  .  simultaneously, 

J 

provided  that  S  is  not  the  set,  cp  ,  which  contains  only  the 
origin.  If  S  =  cp ,  some  of  f^.fs  must  be  allowed  to  increase 
so  that  a  partial  improvement  can  be  made  at  this  step.  This 
relaxation  should  be  made  only  for  one  iteration, 
b.  General  Problem  Considerations 

(1)  Firs  t-Qr  der  System  .  All  normals  n  ,  for  a 
first-order  system,  must  be  of  equal  sign  to  improve  all 
components  locally.  If  this  is  not  the  case,  the  selection 
of  dQ  becomes  subjective  for  a  particular  trial  point. 

(2)  Second-Order  System.  A  second-order  system 
is  considered  next  with  L  <  2.  Since  all  the  normals,  ri , 
have  been  normalized  to  be  unit  vectors,  the  inner  products 

Rij  =  5  1 ,  j  =  l,2,...L;  i?'  j  (III-19) 


indicate  the  nature  of  the  sets,  S^.,  given  by 

s .  .  =  s.  A  s  . . 

ij  1  j 


(in-20) 


R.  .  =  1.0  implies  that  n.  and  n  are  parallel,  therefore 
ij  H  “I  “J 


S.  =  S.  =  S  . . 
1 J  1  J 


(III-21) 


as  indicated  in  Figure  1. 
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Figure  1. 


Intersection  of  2  half-spaces  in 
2-space .  R . .  =  1 . 


R  *  .  -  -  1.0  implies  that  n.  and  n. 

-i  -j 

fore 


are  anti-parallel 


as  indicated  in  Figure 


=  H. 

i 

2  . 


H  . 
J 


Figure  2. 


Intersection  of  2  half-spaces  in 
2-space  .  R .  .  =  -1 . 


there* 

( 1 1 1-22  ) 
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If  R.  .  /  +  1.0  then  there  exists  a  region,  R  ,  where  both 
1  j  s 

inner  products  and  ^  are  greater  than  zero,  as 

required  to  reduce  the  design-measure  difference  elements 
f^  and  f  .  simultaneously.  This  is  depicted  in  Figure  3* 


Figure  3 * 


Intersection  of  2  half-spaces. 


R  .  .  j£  +  1. 


Suppose  that  L  -  3  for  a  second-order  system. 

If  R  /  +  1  then  n  and  n  are  linearly  independent  and  n 
12  —  — I  — 2  — 3 

can  be  expressed  as  a  linear  combination  of  and  n  by  the 
r  ela  t ionship 


where  N  is 


—3  = 

the  partitioned  matrix  given  by 


N  = 


Hi!  n2 


(III-23) 


(III-24) 


and  a^  is  a  column  vector  with  components  a  ,  a^. 

For  example,  Figures  4  thru  11  depict  the 
relationships  that  can  exist  between  half-spaces  and 
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In  Figure  4, 


for  various  combinations  of  a,  and  a  . 

1  2 

contains  the  intersection  of  S,  and  S  ; 

1  2  ’ 

dropped  from  consideration. 


therefore  S_.  may  be 
3 


Figure  4-  Intersection  relationships  for  a^O,  a 2>0 . 

The  same  situation  holds  in  Figures  5  and  6,  where  Sx  and  s2 , 
respectively,  may  be  dropped  from  consideration. 


Figure  5-  Intersection  relationships  for  a^>0,  a^<0. 


31 


may  be  dropped  from  consideration  in  both  cases 


Figure  7.  Intersection  relationships  for  a^  =  l,  a2=0. 


Figure  8. 


Intersection  relationships  for  a^O,  a2  =  l. 
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In  Figures  9,  and  11,  S,  ^  S.fl  S  -  0;  therefore  at  least 

i^o 


one  must  be  dropped  from  consideration  to  have  a  non-zero 


dg. 


Figure  9- 


Intersection  relationships 


for  a  =■!. 


Figure  10. 


Intersection 

Vs-1- 


relationships 


for  a i=0  .  , 


33 


Figure  11.  Intersection  relationships  for  a  <0  ,  a  <0. 


s±n  s2n  s3  =  o. 


The  general 

Table  II. 

results 

related  to  these  figures  are 

!  tabulated  in 

Figure 

a2 

Relationship 

Dr  op  Fr  om 

Cons iderat ion 

4 

>0 

>0 

s3^-sins2 

S3 

5 

>0 

<0 

s1H.s2  f>  s3 

S1 

6 

<0 

>0 

s3 

S2 

7 

>0 

=0 

S3  =si 

S3 

8 

=0 

>0 

S2  =S3 

S3 

9 

<0 

=0 

s,  n  s=h  =h  ;  s,  n  s  n  s  =  9 

1  0  1  J  1  ^  0 

Sl  or  S3 

10 

=0 

<0 

S,  n  S  ^  S  =  cp  ;S  ^  S  =H  =H_ 
12j  23^0 

S2  or  S3 

li 

<0 

<0 

sins2ns3=  * 

or  S2  or  S 

Table  II.  General  relationships  for  sets  S_. , 
j  =  1,2,3  for  a  second-order  system 
when  /n,,J22\  /  1  !• 
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As  an  example,  if  Table  II  has  indicated 


that  should  be  dropped  from  consideration,  the  normals 
—X  may  ke  used  to  form  a  vector,  d<Qf  ,  that  lies  in  the 
region  given  by  the  angle  in  Figures  12  and  13.  dQ* 
is  defined  by  - 

dQ*  =  1%  j  £2J  -  (Hi-25) 

where  £  is  a  column  vector  with  components  c  ,c  .  If  c  and 
c2  are  restricted  to  be  positive,  then  dQ*  lies  in  the  region 
R*  which  is  contained  by  if  ^n^n^S  0,  as  in  Figure  12. 

contains  R^  if  ^,11^  <  0,  as  in  Figure  13.  For  dQl  to 
lie  within  the  region  R^,  the  angles  0^  ,  and  ©2  must  both  be 


less  than  or  equal  to  90  degrees .  Let 

dQ* 

dQ  =  , —  ■  ~ T 


N](dQ|)2  +  (dQ^)2 


(  HI-26) 


Then  the  restrictions  on  9^  and  9^  become 


o\ 


and 


^n2,dQ\  £  0 


J 


(III-27) 


Figure  12. 


Region  relationships  for 


<ai  •-*) 


2  0. 
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Figure  13*  Region  relationships  for  ^n^  ’—2^  <  ^ • 


The  procedure  discussed  above  considers  only 
three  normals,  ru ,  j  =1,2,3,  at  a  time,  but  can  be  extended 
to  the  case  where  L  >  3  in  an  iterative  fashion.  At  each 
iteration,  one  is  dropped  from  consideration  using  Table  (II) 
This  process  is  continued  until  all  n.fs  have  been  considered. 

(3)  Third-Order  Systems .  For  a  third-order  system, 
similar  reasoning  is  used  to  develop  a  basis  of  three  linearly 


four  th 

n  or  ma 1 

n ,  can  be 

—4 

represented  by 

=  an., 

+  a^n^ 

+  a  n  ^ 

(m-28) 

1—1 

2—2 

3-3 

=[-i !  - 

2 ;  %] 

a 

(III-29) 

=  Na 

(III-30) 
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3 

If  all  a.  £  0,  then  S fi  S.  and  S,  can  be  dropped  from 
3  j=l  J  ^ 

consideration.  If  all  a.  <  0,  ^  S  .  =  cp  and  one  of  the 

J  j=l  J 


four 

S  .  fs 
J 

must  be  dropped  from  consideration.  Table  III 

gives  the 

app 

r  opr iate  r  el at  ions hips 

for  n  =  3,  L  =  4?  Where 

any 

3  of 

the 

normals  ri  are  linearly 

indepen den  t . 

a 

1 

a2 

a3 

Rela  t ionship 

Drop  From  Consideration 

£0 

£0 

£0 

s  =>  s^s.ns, 

7T  1  2  3 

s4 

<0 

<0 

<0 

4 

r\  si  =  <P 
j=i  J 

S  or  or  or  S, 

12  3  4 

=0 

>0 

<0 

s^.s, 

2 —  13  4 

S2 

=0 

<0 

<0 

4 

r>  s .  =  cp 

3=1  J 

S2  or  or 

>0 

<0 

<0 

sn3s„ns_  ns. 

S1 

>0 

>0 

<0 

sins2ns3  is 

intersected  by 
in  such  a  way  asn 
to  form  a  fourth 
bounding  hyperplane. 

Table  III.  General  relationships  for  sets  S.? 

j  =  1 ,  .  .  ,4  for  a  third-order  system 
when  n_^,  and  n  are  linearly 
independent 


The  relationships  that  exist  for  a^  >  0, 
a  >  0  and  a  <  0  in  Table  III  imply  that  many  boundary 
hyperplanes  could  exist  for  systems  of  order  higher  than 
two  when  the  number  of  hyperplanes,  L,  is  greater  than  the 
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order  of  the  system  under  consideration.  Results  from  linear 
algebra  LlOj  can  be  used  to  show  that  there  may  be  L-(n+l) 
bounding  hyperplanes  and  therefore  L-(n+l)  normals  to  con¬ 
sider.  For  this  reason,  the  algebraic  development  was  not 
pursued  further  for  cases  where  L  ^  n+1. 

The  set  of  hyperplanes  not  excluded  from 
consideration  form  a  convex  polyhedral  cone  in  n-dimens iona 1 
Euclidean  space.  Unit  vectors,  defined  as  being  colinear 

with  the  extreme  edges  of  this  cone,  when  summed  with  positive 
weighting,  form  an  interior  vector  of  the  cone.  These  unit 
vectors,  u^ ,  can  be  found  using  linear  programming  techni¬ 
ques  1 11  J  . 


The  problem  may  be  reformulated  into  the 


Simplex  format  as  follows.  The  linear  function 

n 

Z  =  2  y  . 
i=l  i 

is  to  be  maximized  subject  to  the  constraints 

°  J  =  1,2, •••.!. 


Iyi  <  ” 


i  -  1 , 2  ,  .  .  .  ,  n 


(HI-31) 

(III-32) 

(III-33) 


£  y  .  s  B 
i  =  l  1 


(111-34) 


where  B  is  a  positive  number  If  z  can  be  maximized  by  the 
Simplex  routine,  Z  will  be  equal  to  B,  and  there  may  be  more 
than  one  solution  y.  If  there  is  no  solution,  one  of  the  con- 

-j 

straints  in  equation  (111-32)  must  be  relaxed.  If  there  are  multiple 
solutions,  each  solution,  . ,  forms  a  vector  which  is  colinear 
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with  an  extreme  edge  of  the  polyhedral  cone  formed  by  the  set 

L 

s  =  n  s.  (in-35) 

j=i  J 

( See  Figure  14. ) 


Figure  l4.  Intersection  ol  3  hyperplanes  in  3~sPace. 

The  Simplex  approach  requires  from  one  to 
L  -  n  applications  of  the  Simplex  routine.  It  was  felt  that 
the  computation  required  was  too  complex  and  time-consuming 
to  allow  the  overall  algorithm  to  be  a  feasible  design  tool. 

If  L  is  restricted  to  be  less  than  or  equal 
to  n  +  1 ,  the  algebraic  procedures  considered  previously  may 
be  applied  to  find  the  normals  of  the  boundary  hyperplanes. 
For  ease  of  computation  and  to  make  the  algorithm  feasible, 

L  was  further  restricted  to  be  less  than  four. 
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Problem  Considerations  for  L  ^  n  +  1 


c  . 


If  the  partitioned  matrix 

N  =  [nl5n2,...,nL] 


(111-36) 


is  considered,  the  rank  of  N ,  r(N),  gives  the  number  of 

independent  normals.  If  r(N)  =  L  then  all  normals  are 

\ 

independent.  The  vector  _dQr  given  by 


dQ  =  Nc 


( III-37) 


will  be  interior  to  the  set 


s  =  n  s 

j=i  3 


(in-38) 


if  the  elements  of  c_  are  non- nega  t  ive .  If  r(N)  <  L  then  the 
L-r(N)  half-spaces  S  . ,  associated  with  the  linearly  dependent 
normals  removed  from  N  (for  this  step  only)  to  give  the  re¬ 
duced  matrix  Nf-  Then  dQ?  is  given  by 


dQ T  =  N*c 


( I II- 39) 


where  £  is  now  an  (r(N)xl)  row  vector  with  positive  equal 
elements. 

Table  II  gives  the  general  relationships  that 

exist  for  an  n^-order  system  when  L  =  3  and  r(N)  =  2. 

t  h 

Similar  relationships  are  given  in  Table  IV  for  an  n  -order 
system  with  L  =  3  and  r(N)  =  1  .  Table  V  gives  the  relationships 
that  exist  for  an  nth-order  system  with  L  =  2  and  r(N)  =  1. 
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Table  IV.  General  relationships  for  sets  S.3  S. 

11 


and  S,  where  n 
k 

-  2,  L  =  3  and  r (N)  -  1  . 

n,  -  a  n  .  •  n  .  = 
— k  l—i  —  j 

an  . 

2-1 

al 

a2 

Relationship 

Drop  From  Consideration 

>0 

>0 

s.  =  S  .  =  S, 

i  j  k 

none 

>0 

<0 

s.^s.ns,  =h.  .. 

S  .  j  or  S  .  and  S, 

J  1  k 

<0 

>0 

S.^S.^S,  =  H. 

i  j  k  l , j ,k 

S,  j  or  S .  and  S  . 
k  i  j 

<0 

<0 

s.n  s./is,  =  h .  .  . 

i  j  k  i,j,k 

S.  ,  or  s  .  and  S, 
l  j  k 

Table  V.  General  relationships  for  sets  S.  and  S. 

i  J 

where  n  ^  2,  L  =  2.  r(N)  =  1.  n.  =  an. 

'  '  —  j  — i 

a 

Rela  t ionship 

Drop  From  Consideration 

>0 

S  .  =  S  . 
i  J 

none 

<0 

S.Hs.  =  H.  or  H 

S.  or  S  . 

’S  v/  O  •  F  1  O  .  II.  J.  II  O  .  ^  J- 

i  3  1  J  1  J 

The  vector  ^dQT  found  by  Equations  111-37  or 
III-39,  when  normalized  to  unit  length  gives  the  dQ  required 
in  step  f.  of  the  algorithm  for  selecting  a  new  weighting 
matr ix  Q. 
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IV.  EXAMPLES 


A.  A  SECOND-ORDER  EXAMPLE 


9 


The  second-order  system  selected  for 
iven  in  phas e- var iable  form  by 


0.0  1.0 

0 

tl 

•7l 

x(t)  + 

-20.  -5.0 

1 

consideration  is 


u(  t)  .  (IV-1) 


The  final  time,  t^_,  was  arbitrarily  set  at  2.5  seconds.  The 
design  measure,  m,  selected  for  examination,  had  the  following 
elements : 

m^  -  percent  overshoot  for  x^(t) 

mQ  -  time  to  maximum  overshoot  for  x^(t) 

m^  -  max  |u(t)|  ,  0  £  t  ^  tf 


which  had  the  desired  values 


* 

m 


5-0  % 

0.925  seconds 

0  .0 


Percent  overshoot  is  defined  by 

overshoot  of  x^(t) 


x1(0) 


xlOO , 


(IV-2) 


(IV-3) 


1 .  Estimation  procedure 

The  first  method  used  to  select  a  suitable  weighting 
matrix  Q  was  to  guess  an  initial  Q,  solve  for  the  design 
measure  m  and  then  make  a  new  estimate  for  Q  based  on  m.  This, 
of  necessity,  was  accomplished  on-line  with  the  IBM  3^0-67 
computer  in  a  time-sharing  mode. 
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The  estimation  procedure  used  is  given  in  the 
following  steps. 

a  .  Gues s ing  Q1 

b.  Evaluating  m 

c.  Repeating  steps  a.  and  b.  until  one  element  of 

* 


m,  m..  was  close  to  m.* 

J  J 

i+1  * 

d.  Selecting  Q  so  that  m.  remained  close  to  m. 

J  J 

and  improvement  was  made  on  one  of  the  other  elements  of  m. 
This  was  accomplished  by 

(1)  Perturbing  Q1 

(2)  Evaluating  m1 

(3)  Repeating  steps  (1)  and  (2)  until  a  direction 

of  change  was  established  that  improved  one  of  the  other 

* 

elements  of  m  while  keeping  m^  close  to  m_^. 

(4)  Changing  Q1  as  far  as  possible  in  the 
direction  determined  above. 

e.  Step  d.  was  repeated  until  all  of  the  elements  of 

m  were  as  close  as  possible  to  their  associated  elements  in 
* 


m  .  This  procedure  changes  Q  along  a  contour  of  m^  in  the 
qll~q22  Plane- 

Using  this  procedure  led  to  the  weighting  matrix 
Q  =  diag  [85.6,  13-6],  with  a  computation  time  estimated  at 
25  minutes. 

2 .  Exhaustive  Search 

The  exhaustive  search  for  the  second-order  example 


was  arbitrarily  restricted  to  the  region  R  defined  by 

fy 


R: 


0  £  q  £  100. 
0  *  q22  *  2°- 


(IV-4) 
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R  was  divided  into  grid  points  with  intervals  of  dq^^=2.0 

and  dq^^=0.25;  dq^ ^  was  required  to  be  this  small  by  the 

low  sensitivity  of  m  and  m  with  respect  to  q  .  This 

i  £  11 

low  sensitivity  can  be  seen  in  Figures  15  and  l6 .  Approxi¬ 
mately  100  minutes  of  IBM  360-70  computation  time  was  re¬ 
quired  to  complete  the  evaluation  of  m  at  all  grid  points. 

Figures  15?  l6  and  17?  obtained  from  this  search, 

give  contours  for  selected  values  of  m  ,  m  and  m  .  Figure  l8 

t  ^  3 

is  a  composite  of  these  figures.  Graphical  construction 
indicates  that  the  desired  weighting  matrices  is  in  a  neigh¬ 
borhood  of  Q  =  diag  L8l.0,  12, 8J  . 

3 .  Application  of  Design  Algorithm  to  Select  Q 

The  algorithm  given  in  Chapter  III  was  applied  with 
all  three  elements  of  m  being  considered  in  the  selection 
procedure  for  dQ ,  for  three  initial  Q?s.  Two  initial  Qfs 
were  selected  to  test  the  algorithm  with  only  m^  and  m^  being 
considered  in  the  selection  procedure  for  dQ.  The  results  of 
these  trials  are  given  in  Table  VI . 

Attempts  were  made  to  test  the  algorithm  with  only 
m  and  m  or  m  and  m  being  considered  in  the  selection 

_L  c,  £  3 

procedure  for  dQ  The  moves  made  by  the  algorithm  did  not 
tend  to  improve  the  element  not  being  considered,  or  approach 
a  best  Q  for  all  three  elements  of  m.  This  is  partially  due 
to  the  insensitivity  of  m  ,  with  respect  to  Q.  This  insensi¬ 
tivity  was  exaggerated  by  the  non-con t inuous  nature  of  time 
in  the  digital  computer  calculations. 
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Figure  15.  Q^2  P^-31*2  showing  contours  for  selected 

values  of  percent  overshoot  of  x,. 


1.50 


46 


maximum  overshoot  of 


r\j 
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Figure  17.  0.,-Q  Plane  shewing  contours  for  selected  values 
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Figure  18.  Composite  of  Figures  15,16,17. 


Figures  19,  20  and  21  show  the  initial  iteration 
moves  made  by  the  algorithm  for  trials  1,  2  and  4  in  the 

plane.  For  the  initial  points  tested,  the  largest 
number  of  iterations  required  to  move  Q1  (the  superscript 
i  refers  to  the  latest  iteration  number)  to  close  proximity 
to  the  best  Q  was  eight.  (No  claim  as  to  the  uniqueness  of 
a  best  Q  is  made  for  this  algorithm  as  this  depends  on  the 
system,  initial  ,  and  design  measure  being  considered.) 

From  the  point,  Q1 ,  which  is  in  close  proximity  to  the  best 
Q,  at  least  20  and  not  more  than  3°  iterations  were  necessary 
to  arrive  at  a  locally  unimprovable  weighting  matrix,  denoted 
by  Q"^ .  The  Q^*s  thus  found  were  not  equal,  although  all  de¬ 
sign  measure  elements  were  considered  to  be  satisfactory. 

The  largest  variation  being  in  q 5  to  which  all  elements  of 
m  are  relatively  insensitive  in  this  region. 


Table  VI.  Results  for  Second-Order  Example 


L 

m  .  *  s 

Initial 

Final 

Final 

C^ns ider  ed 

Q 

Q 

m 

to  select 

d Q 

1,1 

2,2 

1,1 

2,2 

1 

2 

3 

3 

10.0 

1.0 

81.37 

12.897 

5.0057 

0.925 

2.075 

3 

ml’m2’m3 

1  .0 

10. C 

83.46 

12 . 864 

5.016 

0.925 

2.062 

3 

ml’m2’m3 

100.0 

1  .0 

80  44 

12.683 

5.08 

0  925 

2.044 

2 

m1  >m3 

10.0 

1  .0 

79.81 

12.916 

5.0001 

0.925 

2.076 

2 

ml  ’m3 

100.0 

1.0 

8l.4l 

12.914 

4.9999 

0.925 

2.0226 
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Figure  19.  Algorithm  moves  for  trials  l(-),  2(+),  and  4(0)  on  overshoot 
contour  plot  (initial  moves  only) . 
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Figure  20.  Algorithm  moves  for  trials  1(*K  2 (+) ,  arri  4(0) 
overshoot  regions  (initial  moves  only) . 
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B.  A  THIRD-ORDER  EXAMPLE 

The  third-order  system  considered  was  taken  from  L4l. 

It  is  for  the  linearized  incremental  longitudiual  motion  of 
an  aircraft..  The  system  is  given  by 


x(t)  = 


-0.0016  1.0  -.0002 

-0.1569  -0  0015  -.1131 
0.0  0.0  -.666 


x(  t) 


0.0 

0.0 

0.666 


u(  t)  . 


( iv-5) 


The  final-time,  t^ ,  was  arbitrarily  set  at  2.5  seconds.  The 
design  measure,  m,  selected  for  examination,  had  the  following 
elements : 

m^  -  percent  overshoot  for  x^(t) 

m^  -  time  to  maximum  overshoot  for  x^(t) 

m  -  max  j  u ( t ) |  ,  0  ^  t  ^  t 
J  t 


which  were  assigned  the  desired  value 


m 


4.5  % 

0.91  sec 

0.0 


( iv-6 ) 


The  system  was  transformed  to  the  phase- val iable  form  in 
the  manner  of  [ 5j •  The  transformation  matrix 


T  = 


-41.329  -0.08026 

-  3.41561  -41.329 

52.809  1.406 


0.0 

1.536  x  10  ' 
6.71141 


( iv-7) 


results  in  a  system  matrix  given  by 


A0 


0. 

0, 
-53 » 


1 . 

0 . 

-8.88 


0. 

1. 

-6.8 


( iv-8 ) 
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Therefore  the  system  is  given  by 


z(t) 


An£(t)  + 


0 

0 

1 


u(t) 


( IV-9 ) 


The  design  measure,  m,  is  defined  with  respect  to  the 
original  states.  Since  it  was  desired  to  observe  the  state 
trajectories  for  both  the  phase-variable  form  and  for  the 
original  states,  the  computer  program  was  written  to  trans¬ 
form  the  phase  state  zj  t )  to  x(t)  at  each  integration  step, 
in  order  to  evaluate  mc  A  more  direct  method  is  to  trans¬ 
form  the  diagonal  weighting  matrix  to  the  general  form,  Q 

9 

and  perform  all  integration  in  the  original  state  form. 

Q  is  given  by 

Qg  =  (t'1)TQ(t"1) .  (IV-10) 

Kriendlerfs  Z 4]  selection  for  the  original  system 

weighting  matrix  is  Q  =  diag  [lO.O,  0.5,  O.Oj.  This  Q 

9  9 

led  to  the  design  measure 


m  = 


4.497 

lol 

97.2 


( i v- 11 ) 


No  attempt  was  made  to  guess  the  best  Q,  or  to  use  the 
exhaustive  search  method,  as  it  was  felt  the  expected  results 
would  not  have  been  worth  the  time  or  effort  involved. 

The  algorithm  given  in  Chapter  III  was  applied  to  the 
third-order  example,  with  one,  two  and  three  design-measure 
elements,  m_.  ,  being  considered  in  the  selection  procedure  for 
dQ.  The  results  of  this  application,  with  test  points,  are 
tabulated  for  all  trials  in  Table  VII. 
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Favorable  results  on  any  one  trial  depended  on  the  initial 
0 

weighting  matrix,  Q  ,  selected  and  on  the  elements  m^ ,  being 

considered.  The  first  trials  (1-8  in  Table  VII)  were  made 

considering  either  all  three  elements,  m.,  or  elements  in 

j  1 

.  .  .  .  .  f  * 

and  m^-  Most  initial  points  resulted  in  an  m^  close  to  m^ , 

f  *  f 

but  ra  could  not  be  reduced  to  m  ;  m  was  at  an  apparent 

£  £  3 

local  minimum  in  Q  space.  Those  trials  that  considered  all 
design  measure  elements  in  the  selection  of  dQ  tended  to 

reduce  more  rapidly  in  the  local  region. 

3 

Since  m^  seemed  to  be  least  changeable  for  these  first 

0  .  f 

trials,  a  starting  Q  was  selected  that  had  resulted  in  m^ 

* 

close  to  m^ .  A  trial  (9)  was  then  made  considering  only  m^ 
for  selecting  dQ .  The  result  was  a  significant  reduction  in 

did  not  increase  unreasonably.  Sub¬ 
sequent  trials  alternated  between  considering  m^  and  con¬ 
sidering  both  m^  and  m^  in  the  selection  procedure  for  dQ, 

f  I  * 

with  a  resulting  Q  that  reduced  both  m^-m 

to  an  acceptable  level.  The  Q^  thus  found  was  used  as  the 

...  0 

initial  Q  in  a  trial  (lq)  where  all  three  elements  m. ,  were 
considered  in  the  selection  procedure  for  dQ.  This  trial  ( l4 ) 


* 

* 

m  -rri 

whil  e 

m_  -m.. 

2  2 

1  1 

I  * 

1  * 

rn  -m. 

and 

m  -m^ 

1  1  1 

2  2 

significantly  reduced  both 


* 

* 

m_,  -m_ 

and  m  -m_ 

1  1 

J  2  2 

in  two 


iterations  Tests  in  the  neighborhood  of  the  Q  found  in 
trial  ( l4 )  showed  that  the  element,  q  ,  was  zero  f°r  fhis 


s  y  s  t  em  . 
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TABLE  VII  .  RESULTS  OF  TFSTING  ALGORITHM  ON  A  THIRD- 
ORDER  EXAMPLE 


TRIAL 

ACTIVE 

0: INITIAL 

I 

0(1.1) 

MU  ) 

NC. 

CONSTRAI NTS 

F:F INAL 

ELEMENTS 

TsTEST 

1 

1.2 

0 

1 

17000. 000 

4.  6 

c . 

850. OC 

1  .  1 

3 

1.0F-9 

95.  8 

F 

1 

17?0C. no 

4.  56 

855.80 

1.  1 

1. OE-9 

96.17 

? 

1.2 

n 

1 

1232.0 

5.  55 

2 

649.0 

1.48 

3 

1  .OE-9 

32.  46 

F 

1 

11526.0 

4.  50 

7 

912.5  . 

1.175 

3 

1.  OF-9 

73.  89 

3 

1.2.3 

0 

1 

11 530. G 

4.  5 

2 

312.  5 

1.175 

3 

1.  OF-9 

73.  8° 

F 

1 

11524.2 

4.  51 1 

2 

811.2 

1.  175 

3 

1.  OE-9 

73. 884 

u 

1  ,2 

0 

1 

17090.0 

.4.  5  584 

? 

835.0 

1.  1 

3 

1 . OE-9 

35.  U6 

F 

1 

17439.83 

4.4969 

2 

866. 6843 

1.  1 

j 

1  • OE-9 

97.231 

T 

i 

174Q0.0 

4.4968 

2 

866.  7 

1.  1 

7 

1  .OE-9 

°7. 231 

c 

1.2,  3 

0 

1 

1 743°. 3 

4.  497 

7 

866.68 

1.  1 

3 

1 .OF-9 

97. 231 

F 

1 

17490.21 

4. 5021 

7 

845.9717 

1.  1 

i 

1. OF-9 

97.231 

6 

1.2 

0 

l 

10000. 0 

16. 71 7 

2 

1.0 

1.05 

*5 

0. 0001 

65.  6 

F 

1 

10034.00 

9.  53 

7 

596.23 

1.0125 

3 

-  28.93 

65.  45 

0 

1 

10031.27 

6.  78 

•"> 

585.9265 

1.15 

3 

0.  01 

66.  95 

F 

1 

10049.01 

4. 5028 

2 

786. 7831 

1.225 

3 

4. 6321 

67. 561 

C 

1 

10049.01 

6.78 

2 

736.  789] 

1.225 

3 

4.6321 

67. 561 

F 

1 

10049.07 

4.491 

2 

786. 24R5 

1. 225 

3 

5.4707 

67.  596 

F 

i 

10049.07 

4.6164 

-i 

c 

736.2485 

1.2 

7 

0.01 

67.  353 

F 

1 

10057. 14 

4. 5021 

2 

802. 4175 

1.2 

3 

-1. 65517 

67. 338 

7 

1,2,3 

0 

1 

10057.14 

4. 5021 

7 

C. 

802.4175 

1.  2 

3 

-1.65517 

67. 338 

F 

1 

10057. 13 

4. 4764 

2 

802. 783 

1.2 

3 

-0.72456 

67.382 

0 

1 

10500.00 

4. 5053 

7 

802. 00 

1.  1875 

3 

1.0F-8 

69.40 
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TARL  F  VI  I  .  CONT  INIJFD 
TRIAL  ACTIVE  OrlNITIAL 

NCU  CONSTRAINT  FlFINAL 

FLEMFNTS  T  :  TF  ST 

F 

R  1,2  0 

F 

9  2  0 

F 

1C  1,2  G 

F 

112  0 

F 

12  1,2  n 

F,n 

F 

13  2  G 

F 

0 

F 


14  1,2,3  r 


F 


T,n 


F 


T,n 


F 


I  0(1,11 


1  10523.35 

2  »3  . 5637 

3  l.OF-8 
1  20000.00 

2  1000.00 
3  1.0F-7 

1  20007.16 

2  836.54 

3  1.0F-7 
1  20000.00 

2  836.0 

3  1.0E-7 

1  46490.00 

2  886.0 

3  l.OF-7 

1  46490.0 

2  836.0 

3  l.OF-P 

1  46493.05 

2  1039.  55 

3  l.OF-B 

1  46493.05 

2  1039.  55 

3  1.0E-7 

1  47493,05 

2  91^.547 

3  l.OF-7 

1  47403.05 

2  914.547 

3  l.OF-7 

1  47242.65 

2  1083.  722 

3  l.OF-7 

1  46246.  18 

2  1033.933 

3  l.OF-7 

1  46246.18 

2  1033.933 

3  1.0E-7 

1  50000.00 

2  1033.033 

3  l.OF-7 

1  50C00.0C 

2  1033.033 

3  0.01 

1  51000. CC 

2  1033.933 

3  0.01 

1  51000.00 

2  1083.  933 

3  0.01 

1  51001. OC 

2  1116.933 

3  0.01 

1  51001. OC 

2  1116.933 

3  l.OF-7 

1  51000.85 

2  1116.74 

3  1.0E-7 

1  51000.  35 

2  1116.74 

3  C.001 

1  51  COO. 85 

2  1116.75 

3  -C.0997 


M  (  I  I 


4.1638 
1.2 
69.56 
3. 7668 
1.0875 
106.12 
4. 5082 
1.075 
106. CO 
4. 5115 
0.9 

105.98 

5.4 

0.9 

178.14 
5.4 
0.  9 

178. 14 
4.4895 
0.  925 
178. 33 
4.4395 
0.925 
178 . 33 
5.  29C6 

0.  9 

180.45 
5,  2  QC6 
0.  9 

180.45 
4. 5338 
0.9125 
180.03 
4. 5065 
0.925 
177. 76 
4. 5065 
0.925 
177.76 
u»  6105 
0.9125 
186.19 
4. 6 1 C? 
0.9125 
186.19 
4.6371 
0.9 

138.38 
4.6371 
0.  9 

188. 38 
4, 50C5 
0. 9125 

188.42 
4. 5007 
0. 9125 
188.4? 

4. 5015 
0. 9125 
188.41 
4. 5015 
0. 9125 
188.41 
4. 4033 
0. 9125 
188.41 
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TABLE 

VII  .  CONTI NUEO 

TF  IAl 

ACTIVE  . 

0 : I N I T I AL 

I 

OII.II 

M(I) 

N(?. 

CONSTRAINT 

F:F  INAL 

ELEMENTS 

T  :  T  F  S  T 

15 

!  ,2,  ? 

T  »0 

1 

51  COO. 85 

4.5056 

2 

1116. 754 

0.  9 

3 

-0.198 
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The  best  Q  found,  using  the  algorithm,  transforms  to  the 


or iginal 


Q 


S 


system  form,  Q  ,  given  by 

g 

29.87207  -0.112076 

-0.112076  6.54338 

/r 

-1.393  x  10”  2.705  x  10 


-1.39  x  10 


-6 


2.705  x  10 
6.497  x  10 


-14 


( IV- 12 ) 


which  is  positive  definite. 

C.  DEMONSTRATION  EXAMPLE 

A  second-order  example,  that  had  not  been  considered 
previously,  was  selected  for  a  comparison  of  the  tr ial-and- 
error  estimation  procedure  and  the  design  algorithm.  This 
system  is  given  by 


x(t)  = 


0  .0 

-1.0 


1  .0 

-1.0 


x(t)  + 


0.0 

1.0 


u(  t)  . 


(IV-13) 


The  final-time  was  arbitrarily  set  at  2.5  seconds.  The  design 
measure,  m,  considered  had  the  following  elements: 

-  percent  overshoot  for  x  (t) 
m^  -  time  to  maximum  overshoot  for  x^(t) 
m^  -  max  |u(t)|  0  ^  t  ^  t^  , 


which  had  the  desired  value 


* 

m  = 


5.0  % 

0 . 925  sec  , 

0.0 


(iv-i4) 


The  estimation  procedure  was  applied  for  several  startin 

*  * 


points,  with  no  success  in  satisfying  both  m^  and  m0 . 

Q  =  diag  [500-0,  0.0J  was  the  most  satisfactory  point  found; 
the  design  measure  for  this  Q  was  mT  =  [4.629,  -9^5?  21.971. 
CPU  time  was  seven  minutes . 


g 
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The  design  algorithm  was  applied  for  an  initial 

Q  =  diag  LlOO.O,  O.lJ,  with  only  m^  and  m^  being  considered 

in  the  selection  of  dQ.  After  five  iterations,  an  unimprovable 

weighting  matrix,  Q  =  diag  L 100 . 56 ,  0.11539J,  was  obtained, 

T 

which  had  the  design  measure,  m  =  (_5.026,  1.4?  9-59].  With 
only  m^  and  m^  being  considered  in  the  selection  of  dQ,  an 
initial  Q  =  diag  [500.,  O.lJ  resulted  in  Q  =  diag  L499.9998, 
-1.125]  and  mT  =  [5-0022,  0.925,  21.966'J  in  one  iteration. 
Considering  all  three  elements  of  m  in  the  selection  of  dQ, 
an  initial  Q  =  diag  [ 500 . ,  -1.1251  resulted  in  Q  =  diag  [499.5? 
-I.H969]  and  mT  =  [5.OOO8,  0.925,  21.955]  in  six  iterations. 
Five  minutes  of  CPU  time  were  required  to  perform  these  cal- 
cula  t ions . 

Application  of  the  algorithm,  considering  one,  two  of 
three  elements  of  m  in  the  selection  of  dQ,  for  the  initial 
point  Q  =  diag  [ 1000 .  ,  O.lJ,  failed  to  result  in  a  satisfactory 
design  measure.  All  moves  stayed  in  close  proximity  to  the 
initial  point.  This  failure  was  apparently  due  to  the  relative 
insensitivity  of  the  time  to  overshoot  with  respect  to  Q, 
which  was  exaggerated  by  the  discrete  time  intervals  used  in 
the  calculations.  Fourteen  iterations  were  performed  in  4*6 
minutes  CPU  time. 
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V.  SUMMARY  AND  CONCLUSION 


Since  the  optimal  state  trajectory  for  a  linear  regulator 
system  depends  upon  the  weighting  matrices  chosen,  it  is  de¬ 
sirable  to  establish  a  relationship  between  the  weighting 
matrix,  Q,  and  the  design  objectives. 

Many  authors  have  considered  methods  for  selecting  a 
weighting  matrix  for  the  inf  inite-f  ina  1- time  ( =  00 )  problem 
that  result  in  a  system  that  meets  their  requirements.  The 
only  methods  surveyed  that  can  be  applied  to  the  finite- 
final-time  problem  ( t^  <  00 )  are  exhaustive  search  in  Q  space 
and  tr ial -a nd-er r or  adjustment  of  the  Q  matrix. 

The  exhaustive-search  method  appears  to  be  a  feasible 
method  for  selecing  Q  under  very  restrictive  conditions.  The 
region  that  is  investigated  must  be  small  or  computation  time 
borders  on  the  ridiculous.  This  method  is  only  feasible  for 
systems  where  only  two  elements  of  the  weighting  matrix,  Q, 
are  allowed  to  vary. 

The  estimation  procedure  does  not  require  as  many  calcu¬ 
lations  as  the  exhaustive  method  does  for  the  same  system, 
provided  the  subjective  decisions  are  made  properly  and  with 
efficient  use  of  the  computer .  The  procedure  could  be  applied 
in  situations  where  more  than  two  elements  of  the  weighting 
matrix  are  allowed  to  vary,  but  the  information  that  must  be 
processed  by  the  designer  becomes  excessive. 


6l 


It  has  been  shown  that  the  sensitivity  of  the  optimal 

state  trajectory  with  respect  to  the  weighting  matrix  can  be 

evaluated  using  the  influence  function  approach.  Because 

this  evaluation  is  computationally  complex,  and  it  is  necessary 

to  consider  the  time-varying  trajectory  sensitivity  to  select 

a  change  for  the  t ime- invar iant  weighting  matrix,  it  was 

decided  that  this  approach  would  not  be  fruitful. 

The  procedure  selected  for  development  required  the 

formulation  of  a  vector  design  measure,  m.  This  design 

measure  was  composed  of  generally  used  time-domain  system 

characteristics  such  as  percent  overshoot,  time  to  maximum 

overshoot,  etc.,  and  desired  values  were  selected  for  each 

element  of  m.  The  purpose  in  selecting  Q,  therefore  became 

the  minimization  of  the  absolute  difference  between  each 

* 

element  of  m  and  its  desired  value  m  .  This  difference  is 

“  J 

denoted  by 


The  sensitivity  of  the  design  measure, 
must  be  approximated  by  f ini te- dif f er ences 
to  the  finite  differential  dQ  by 

<}mT 

dm  =  r?T  dQ- 


denoted 

dm 


bm 


r  elated 


(V-2) 


This  relationship  was  utilized 
selecting  a  dQ  that  results  in 


the  elements,  f  ,  as  possible. 


to  develop  a  procedure  for 
the  reduction  of  as  many  of 
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The  procedure  for  selecting  dQ  was  incorporated  in  an 
iterative  algorithm  that  attempts  to  select  a  weighting 
matrix  Q  that  minimizes  each  design-measure  difference,  fy 

The  algorithm  was  tested  on  three  examples,  twb  second- 
order  systemsand  one  third-order  system.  These  tests  were 
carried  out  on  the  IEM  3^0-67  computer  system  operating  in 
a  time-sharing  mode.  Operation  in  this  mode  was  mandatory 
due  to  the  subjective  decisions  that  are  required  by  the 
procedure  for  selecting  dQ. 

Computer  CPU  time  for  the  third-order  example  was  approxi¬ 
mately  91 . 3  minutes.  It  should  be  noted  that  this  time  in¬ 
cludes  many  calculations  that  were  made  solely  to  check  out 
the  algorithm.  A  designer  who  was  reasonably  familiar  with 
this  algorithm  should  require  no  more  than  one- third  that 
time  to  develop  an  acceptable  design  for  a  third-order 
system. 

The  tests  indicate  that  the  procedure  for  selecting  dQ 

is  a  valid  extension  of  Equation  (V-2),  and  does  lead  to  a 

reduction  in  the  elements  f ^  in  a  neighborhood  of  the  Q  in 

question.  The  test  further  indicates  that  the  algorithm  does 

lead  to  a  minimization  of  the  elements  f  for  a  third-order 

3 

system,  if  the  number  of  elements,  m ^ ,  used  in  the  selection 
procedure  for  dQ  is  alternated  in  a  judicious  manner  between 
one,  two  and  three.  Consideration  must  be  given  to  the 


dm  . 

relative  magnitudes  of  the  various  sensitivities,  77-^  , 

OQ^ 

i  =  1,  2,...,n,  j  =  1,2, ...,L,  and  to  the  current  values 
of  m  so  that  needless  and  useless  computation  is  avoided. 
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The  algorithm  developed  in  Chapter  III,  modified  by  the 
consideration  discussed  above,  appears  to  be  a  feasible  pro¬ 
cedure  for  use  in  designing  optimal  controls  for  first-, 
second-,  and  third-order  linear  regulations.  An  extension 
of  the  algorithm  to  linear  tracking  systems  can  be  readily 
ma  de . 


The  extension  of  the  algorithm  to  higher-order  systems 

should  be  limited  in  feasibility  only  by  the  computer  time 

required  to  integrate  large-order  systems  of  differential- 

equations.  The  selection  procedure  for  dQ  developed  in 

th 

Chapter  III  applies  for  n  -order  systems,  provided  that 

the  number  of  design  measure  elements  is  less  than  or  equal 

to  n  +  1.  This  presupposes  that  the  L  hyper  surf aces  in  n- 

* 


dimensional  Q-space,  corresponding  to  the  elements  of  m  , 
have  a  common  intersection. 

It  is  felt  that  further  testing  of  the  algorithm  should 
be  undertaken  before  incorporation  in  a  general  design  pro¬ 
cedure.  This  testing  should  include  higher-order  systems  and 
different  combinations  of  design  measures. 

A  possible  direction  for  future  research  concerns  a  time- 
varying  weighting  matrix,  Q( t ) .  A  less  time-consuming  inte¬ 
gration  scheme,  such  as  on  a  hybrid  analog-digital  computer, 
could  make  the  evaluation  of  the  state-trajectory  sensitivity, 
dx 

— -,  feasible  for  higher-order  systems.  It  seems  reasonable  to 

dQ  ± 
dx 

assume  —  could  be  used  to  adjust  the  weighting  matrix,  Q(t), 
oQ 

to  reduce  the  absolute  difference  between  the  elements  of  the 
state  vector  and  those  of  a  desired  state  vector. 
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